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REMARKS/ARGUMENTS 



Applicant acknowledges the Examiner's review of the specification, claims, and 
drawings. Tn light of the above amendments and the remarks that follow, Applicant requests 
reconsideration or the present application. The amendments and remarks presented herein are 
fully supported by the application as originally filed. No new matter has been enLered. 

Status of the Claims 

Claims 1-14, 16, and 17 are pending in the application. Claim 15 was previously 
cancelled. 

Claim 1,11, and 12 are hereby amended to more clearly define the invention. 



With regard to claim 1, Examiner argues at page 11 lines 2-4 that Kosugc (US 6,571,196) 
discloses 'the processing apparatus is arranged to adjust [t]he value of the offset in a direction 
generally perpendicular with the work surface to the perpendicular distance of the camera's focal 
point from the object plane* 1 . However, this feature is not present in claim 1. Applicant assumes 
from the Examiner's subsequent argument given in parenthesis that the Examiner intended to 
argue that the processing apparatus is arranged to adjust the value of the object edge data 
component by an amount depending on the ratio of the size of the offset in a direction generally 
perpendicular with the work surface to the perpendicular distance of the camera's focal* point 
from the object plane. The Examiner argues that this feature is disclosed a coL 8 line 62-64 of 
Kosugc where it is taught that the XY stage moves the inspection object into a view field of the 
optical microscope. 

Applicant respectfully disagrees. Firstly, this feature of claim 1 stipulates that the 
adjustment must be "by an amount depending on the ratio of the size oftfie offset in a direction 
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generally perpendicular with the work surface to the perpendicular distance of the camera 's 
focal point from the object plane Kosuge does not disclose an adjustment of this amount- 
Secondly, this feature of claim 1 stipulates that it is the processing apparatus that performs this 
adjustmem of the object edge data component i.e. this feature is performed (by the processing 
apparatus) after an image has been captured. In contrast, moving the XY stage as taught by 
Kosuge is performed before an image is captured (sec for example Kosuge col. 46-56), 
Therefore, Kosuge does not disclose this limitation of claim 1 since it docs not disclose that the 
adjustment is by an amount depending on the size of the offset in a direction generally 
perpendicular with the work surface to the perpendicular distance of the camera's focal point 
from the object plane, or that the adjustment is performed by the processing apparatus on the 
object edge data component. 

The Examiner has taken the position that, upon determining that an object edge data 
component is above the work surface, to adjust the value of the object edge data component by 
an amount depending on the size of the offset in a direction generally perpendicular with the 
work surface to the perpendicular distance of the camera's focal point from the object plane is. 
nothing more than adjusting the field of view for the camera. 

Applicant respectfully disagrees. In addition to the reasons stated above, the task of 
determining that an object edge data component is above the work surface can only be performed 
after an image has been captured. Adjusting the Held of view for the camera must be done prior 
to image capture otherwise it can have no effect whatsoever on the captured data. Hence, it is 
impossible for adjusting the field of view for the camera to replicate a feature that includes 
making a determination that an object edge data component (which only exists after image 
capture) is above the work surface. 

In connection with the foregoing, it is noted that the wording of claim 1 stipulates that the 
adjustment of the object edge data component by the processing apparatus is performed "only in 
respect of object edge data components that are determined to relate to an upper edge of the 
object". Hence, the adjustment of the object edge data component stipulated by claim 1 is only 
performed in relation to some of the object edge data components and it is impossible to do this 
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by adjusting the field of view for the camera since adjusting the field of view roust affect all 
image data components. 

The Examiner has taken the view that the offset is when the object is not located in the 
field of view of the camera, which would Include being offset in the x, y, and z plane. However, 
the offset referred to in claim 1 is determined by the thickness of the object at the upper edgq. In . 
order to clarify this, and to further distinguish claim 1 over the Examinees interpretation of the 
term "offset", claim 1 has been amended to remove the word "offset" when used as a noun and 
to instead define the ratio in terms of the thickness of the object at the upper edge. 

Accordingly, claim 1 as amended now recites that "only in respect of object edge data 
components that are determined to relate to an upper edge of the object the processing 
apparatus is arranged to adjust l/te value of the object edge data component by an amount 
depending on the ratio of the thickness of the object at said upper edge to the perpendicular 
distance of the camera '& focal point from the object plane It is noted that Kosuge does not 
disclose this amended feature of claim 1 for the same reasons that are staled above, namely: 
Kosuge docs not disclose "an amount depending on the ratio of the thickness of the object at said 
upper edge to the perpendicular distance of the camera ¥ s focal point from the object plane 
Kosuge does not disclose that the adjustment is performed by the processing apparatus; and 
movement of the XY stage to adjust the field of view cannot allow adjustment "only in respect of 
object edge data components that are determined to relate to an upper edge of the object the 
processing apparatus" since this can only be performed after the image has been captured and, 
even then, only on certain object edge data components, whereas in contrast, adjusting the field 
of view must be performed prior to image capture and must affect al! of the image data* 

Applicant agrees that Kosuge does not disclose an apparatus that determines whether 
each object edge data component relates to an edge of the object that lies on the work surface or 
to an edge that is offset above the work surface; or that projects each image edge data component 
onto the object plane to produce a respective object edge data component in the object plane. 
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Examiner argues that Bachelder (US 5,974,169) discloses that the processing apparatus is 
arranged to project each image edge data component onto the object plane to produce a 
respective object edge data component in the objecl pane. 

Applicant respectfully disagrees. Bachelder is concerned with determining the 
characteristics of an object represented in an image (col. 1, lines 7-9 and col, 2 lines 16-20) and 
discloses a method of identifying the boundaries of an object using bounding boxes (col. 2, lines 
19-24). As can be seen from all of the relevant figures in Bachelder (Le, Figures 3A to 3F, 4A to 
4H and 5A to 5E and the accompanying description), Bachelder is concerned with identifying 
two dimensional boundaries in two dimensional image data. Therefore, Bachelder does not 
attempt to generate three dimensional data representing the object. 

Accordingly, with respect to claim 1, Bachelder does not disclose projecting image edge 
data components onto the object plane to produce a respective object edge data component. This 
is because Bachelder does not attempt to generate three dimensional data representing the object 
and so has no need to do this. The passage of Bachelder referred to by the Examiner in this 
regard (col. 2, lines 26-29) discloses only a method of labelling boundary points, not projecting 
image data into the objecl plane. 

Also, because Bachelder does not generate three dimensional data from the two 
dimensional image data, Bachelder docs not disclose determining whether each object edge data 
component relates to a lower edge of the object that lies on the work surface or to an upper edge 
of the object that is offset above the work surface by an amount substantially equal to a thickness 
of the objecl at said upper edge, as recited in claim 1. Instead, Bachelder only allocates 
boundary points to edges within a two dimensional space. The passage of Bachelder referred to 
by the Examiner is this regard (col. 2, lines 15-34) only discloses that a boundary point falling 
outside a boundary box for a given edge is assumed not to form part of said given edge. Also 
this passage of Bachelder refers to a top or bottom edge of an object, it is an objecl in a two 
dimensional image and not the upper or lower edges of an object represented by three 
dimensional data as stipulated in claim 1. 
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Examiner argues thai it would have been obvious to one skilled in the art to modify the 
apparatus of Kosuge with the technique disclosed in Bachelder* Applicant respectfully submits, 
however, that any such combination could not lead the skilled person toward the invention of 
claim 1 since, as set out above, Bachelder does not disclose any of the features of claim 1 that are 
missing from Kosuge. Moreover, Bachelder is solely concerned with determining the 
characteristics of an object represented in an image (col. 1, lines 7-9 and col. 2 lines 16-20) and 
as such is concerned with identifying two dimensional boundaries in two dimensional image data 
(see in particular Figures 3A to 3F, 4A to 4H and 5 A to 5E and the accompanying description of 
Bachelder). This has nothing to do with generating three dimensional data representing the 
object (as stipulated in claim 1) and so could not lead the skilled person towards claim 1 . 
Examiner argues that the skilled person would combine Bachelder with Kosuge to improve 
methods of determining cliaractcristics of an objeel in an image. However, this has nothing to do 
with the invention of claim 1, which is concerned with generating three dimensional data 
representing the object from image data from a single image. 

Applicant agrees with the Examiner that the combination of Kosuge and Bachelder is 
silent as regards a single image; and that the apparatus is arranged to receive the image data 
components from the camera and to generate, using image data components from a single image, 
three dimensional data representing at least part of the object, and wherein in order to generate 
said three dimensional data the apparatus is arranged to identify a plurality of said image data 
components that represent the position of a respective edge component of the object in an image 
plane. 

Examiner argues that these features of claim 1 may be deduced from the Applicant's 
Admitted Prior Art (AAPA). Applicant respectfully disagrees. The AAPA mentions a 
telecentric lens or a line scan camera being used to generate 3D measurement data from a single 
image. However, a telecentric lens achieves this optically inslead of by manipulation of the 
image data - it creates an image of the same size for objects at any distance and has a constant 
angle of view across its entire field of view. Accordingly, with a telecentric lens, there is no 
need to have a processing apparatus that generates three dimensional data from image data 



PAGE 13/21 1 RCVD AT 6/112009 4:46:57 PM (Eastern Daylight Time] * SVR:USPT0-ff XRF-5/1 * DNIS:2738300 * CSID:616975550S * DURATION (mm-$s):0W6 



JUN-01-2009 16:51 FROM : UGLB 



6169755505 



TO:USPTO 



P. 



Applicant Jan Antonis 

Serial No. 10/822,476 
Page : 13 

components from a single image as set out above. With regard to a line scan camera, this camera 
build up a digital image line-by-line by moving the object and camera relative to one another. At 
any given moment, the portion of the object being scanned is directly in line with the camera's 
line of sight. This means that the image data is always a true representation of the object and 
there i$ no need to have a processing apparatus that generates three dimensional data from image 
data components from a single image as set out above. 

Examiner argues that it would have been obvious to one skilled in the art to modify the 
combined teachings of Kosuge and Bachelder with the AAPA. Applicant respectfully submits, 
however, that any such combination could not lead the skilled person toward the invention of 
claim 1 since, as set out above, the AAPA does not disclose any of the Features of claim 1 that 
are missing from Kosuge and Bachelder. 

Applicant agrees with the Examiner that Kosuge, Bachelder and AAPA together do not 
disclose that said object edge data components that are determined to relate to an upper edge of 
the object are adjusted with respect to the other object data components produced by said 
processing apparatus from said single image. 

Examiner argues that this feature is disclosed by Buckley (US 6,064,759). Applicant 
respectfully disagrees. Buckley docs disclose that actual measurements may be adjusted to 
match a geometric model (col. 28, lines 22-28) and that this results in an accurate prediction by 
the geometric model of surface and edge locations of objects (col. 28, lines 28-30). However, 
Buckley does not disclose that object edge data components that are determined to relate to an 
upper edge of the object are adjusted with respect to the other object data components produced 
by said processing apparatus from said single image. The passages of Buckley do not disclose or 
suggest anywhere that the object edge data components that are determined to relate to an upper 
edge of the object arc adjusted with respect to the other object data components. 

Examiner argues that by incorporating the determining an upper edge from Bachelder 
with Buckley, this feature is disclosed, However, the relevant passage of Bachelder (col. 2, lines 
15-34) refers to a top or bottom edge of an object in a two dimensional image and not the upper 
or lower edges of an object represented by three dimensional data as stipulated in claim 1. 



! PAGE 14/21 * RCVD AT 6/1/2009 4:46:57 PM [Eastern Daylight Time] * SVR:USPT0-EFXRF-5/1 * DNIS:2738300 * CSID:61 69755505 * DURATION (mm-ss):0446 



JUN-01-2009 16:51 FROM : UGLB 



6169755505 



TO:USPTO 



P. 15^21 



Applicant 
Serial No. 
Page 



Jan Antonis 
10/822,476 
14 



Bachelder's teaching is therefore technically incompatible with Buckley in this regard and does 
not, in any event, disclose object edge data components that are determined to relate to an upper 
edge of the object (where the object edge data components belong to three dimensional data as 
stipulated in claim 1 ). 

Examiner argues further that it would have been obvious for one of ordinary skill to 
incorporate the teachings of Buckley with Kosuge (modified by Bachclder and AAPA) to arrive 
at the invention of claim 1. Applicant respectfully submits, however, that any such combination 
could not lead the skilled person toward the invention of claim 1 since, as set out above, Buckley 
does not disclose any of the features of claim 1 that are missing from Kosuge, Bachelder and the 



Examiner argues further that it would have been obvious for one of ordinary skill to 
incorporate the teachings of Buckley with Kosugp (modified by BacheJder and AAPA) to 
optimize the inspection process* to increase the speed and improve accuracy of the inspection. Tn 
this connection, Applicant agrees that the teaching of Buckley is inlendcd to improve accuracy 
by making adjustments to measured values to match a geometric model. However, this has 
nothing to do with the invention of claim 1. The feature of claim 1 that the Examiner argues is 
supplied by Buckley is concerned with adjusting upper edge object data components with respect 
to other object data components when creating three dimensional data representing the object to 
compensate for the effect that the thickness of the object has on the non-adjusted value. This has 
nothing to do with matching values to a geometric model. 

With regard to the Examiner's assertion concerning well known prior art, Applicant 
assumes that the Examiner means that where an object is located on a work surface, its upper 
edge will be offset above the work surface by an amount equal to the thickness of the object at 
the upper edge. If so, then the Applicant agrees with the Examiner but cannot see how this 
feature provides efficient image processing as suggested by the Examiner. 

In summary. Applicant respectfully submits that Kosuge, Bachelder, AAPA, Buckley or 
the Well Known Prior Art disclose, either individually or in combination the following features 
of claim 1: 



AAPA. 
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the processing apparatus being arranged to project each image edge data component onto 
the object plane to produce a respective object edge data component in the object plane, 

the processing apparatus being further arranged to determine whether each object edge data 
component relates to a lower edge of the object that lies on the work surface or to an upper 
edge of the object that Ls offset above the work surface by an amount substantially equal to a 
thickness of the object at said upper edge, 

and wherein, only in respect of object edge data components that are determined to relate to 
an upper edge of the object, the processing apparatus is arranged to adjust the value of the 
respective object edge data component by an amount depending on the ratio of the thickness 
of the object at said upper edge to the perpendicular distance of the camera 's focal point 
from the object plane, such that said object edge data components that are determined to 
relate to an upper edge of the object are adjusted with respect to the ottier object data 
components produced by said processing apparatus from said single image. 

It is therefore respectfully submitted that, since neither Kosuge, Bachclder, the AAPA, 
Buckley or the well known prior art disclose any of the features recited above, their comhined 
teachings could not lead the skilled person to the invention of claim 1 

Further, with regard to the question of obviousness, Bachclder relates purely to 
identification of two dimensional objects in two dimensional images and so its teaching is not 
relevant to, and is technically incompatible with, the generation of three dimensional data from a 
single image. The AAPA teaches the use of a telecentric lens or a line scan camera and so would 
lead the skilled person away from the invention of claim 1. Buckley discloses the use of multiple 
cameras and so would lead the skilled person away from claim 1. 

Accordingly, Applicant respectfully submits that claim 1 is patentably distinguished over 
Kosuge, Bachclder, the AAPA, Buckley and the well known prior art. 



PAGE 16/21 * RCVD AT 6/112009 4:46:57 PM [Eastern Daylight Time] 1 SVR:USPT0€FXRF-5/1 1 DN1S:2738300 * CSID:6169755505 * DURATION (mm*s):0446 



JUN-81-E009 16:51 FROM : UGLB 



6169755505 



TO:USPTO 



P.17'21 



Applicant 
Serial No, 
Page 



Jan Antonis 
10/822,476 
16 



Similar comments apply in relation to claims 12 and 13, which are of corresponding 
scope to claim 1. 

With regard to claims 2 to 4, these claims depend from amended claim 1 and thus 
incorporate the same limitations of amended Claim 1 and are therefore patentably distinguishable 
over Kosugc, Bachelder, Buckley and the AAJPA for at least the reasons set forth above. 

More specifically, claims 2 to 4 define how the object edge data components that relate to 
upper or lower edges are adjusted in situations where an edge profile of the object is 
perpendicular to the object plane or is undercut or beveled. Applicant respectfully disagrees with 
the Examiner that Kosuge discloses the features of claims 2 to 4. For the same reasons given 
above in relation to claim 1, adjusting the field of view of the camera, or moving the camera or 
the stage, cannot replicate the adjustment of object edge data components required by claims 2 to 
4. Moreover, the specific amount of the adjustments given in claims 2 to 4 are not disclosed or 
suggested by Kosuge. With regard to the passage of Bachelder referred to by the Examiner in 
connection with claim 2 (col, 2, lines 15*24), as indicated above, Bachelder refers to a top or 
bottom edge of an object in a two dimensional image and not the upper or lower edges of an 
object represented by three dimensional data as required by claim 2. With regard to the passage 
of Bachelder referred to by the Examiner in connection with claims 3 and 4 (col. 4, lines 64-66), 
the polygonal shape taught by Bachelder is a two dimensional shape in a two dimensional image 
(Figures 3A to 3F, 4A to 4H and 5A to 5E and the accompanying description), whereas claims 2 
to 4 relate to the edge profile of the object in a plane generally perpendicular to the object plane. 
Bachelder docs not disclose an object plane. 

Regarding Claim 5, this claim depends from amended Claim 1 and thus incorporate the 
same limitations of amended Claim 1 and are therefore patentably distinguishable over Kosuge, 
Bachelder, and the AAPA for at least the reasons set forth above. 



Claim 5 recites how the processing apparatus may determine whether or not an object 
edge data component relates to an upper edge or a lower edge of the object. 

The Examiner contends that this technique is disclosed by Bachelder. The applicant 
respectfully disagrees. Firstly, as explained above, the techniques taught by Bachelder are all 
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performed on the iwo dimensional image data and not on the object data as required by Claim 5. 
Therefore Bachelder only refers to a top or bottom edge of an object in a two dimensional image 
and not the upper or lower edges of an object represented by three dimensional data as required 
by claim 5. Secondly, Bachelder is not concerned with creating three dimensional object data 
from the two dimensional captured image data and does not disclose determining whether or not 
an object edge data component relates to a lower edge of the object or an upper edge of the 
object. 

The specific passage of Bachelder (column 9, lines 51 to 63 and 48, 50) identified by the 
Examiner relates specifically to fitting lines 155A to 155D (Figure 5E) to two dimensional 
boundary points 150 (Figure 5D) that have been determined as edge points. Boundary points 
that are outside the bounding boxes as shown in Figures 5B and SC are discarded. It is 
emphasised that this is a two dimensional analysis of two dimensional data in order to perform 
line Fitting and so to model the object. Therefore, Bachelder does not disclose or suggest 
determining whether or not an object edge data component relates to a lower edge of the object 
or an upper edge of the object. 

Moreover, Bachelder does not disclose any of the following other features of Claim 5: 
calculating a respective first parameter relating to a notional reference line extending from the 
object edged data component, calculating a second parameter relating to a notional line 
extending between the object data component and a reference point in the object plane, and 
comparing the difference between said first parameter and said second parameter against a 
threshold value. The Examiner has not indicated where these features may be found in 
Bachelder. 

It. is respectfully submitted therefore that the teaching of Bachelder either on its own or in 
combination with Kosuge, the AAPA and/ or Buckley do not disclose or suggest the combination 
called for in Claim 5. 

Accordingly, Applicant respectfully submits that Claim 5 is patentably distinguishable 
over Kosuge, Bachelder, Buckley and the AAPA. 
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Regarding Claim 6, the features of this claim are dependent on Claim 5. Claim 6 is 
therefore patcntably distinguishable over Kosuge, Bachelder., Buckley and the AAPA for at least 
the reasons set forth above. 

Further, with regard to the passage of Bachelder identified by the Examiner (columns 8, 
lines 32 to 46 in Figure 3E) in relation to Claim 6, this states clearly that Bachelder decides that a 
boundary point in the two dimensional image data corresponds to a top edge of the object simply 
by deciding whether or not it falls into a particular bounding box. This does not involve the 
notional reference lines, first and second parameters, and threshold values comparisons of Claim 
5, or that the first parameter comprises the value of an angle between an angle reference axis and 
said notional reference line extending from the respective object edge data component as 
stipulated in Claim 6. 

Claim 7 depends from Claim 1, and Claim 8 depends from amended Claim 5 and 
ultimately from amended Claim 1; Claims 7 and 8 are therefore patentably distinguishable over 
Kosuge, Bachelder, Buckley and the AAPA for at least the reasons set forth above. 

With regard to claim 7 in particular, the passage of Bachelder identified by the Examiner 
docs not disclose the notional reference lines, first and second parameters, and threshold values 
comparisons of Claim 5, or that the second parameter comprises the value of an angle between 
an angle reference axis and said notional reference line extending between the object edge data 
component and said reference point as stipulated in Claim 1. 

With regard to claim 8 in particular, the passage of Bachelder identified by the Examiner 
does not disclose the notional reference lines, first and second parameters, and threshold values 
comparisons of Claim 5 or that said reference point on the object plane comprises the position of 
the camera's focal point in the object plane and said notional reference line extending from the 
respective object edge data component comprises a line normal to the object at said object edge 
data component, and wherein said threshold value is 90 degrees. 

With reference to Claims 9 and 10, Claims 9 and 10 depend from amended Claim 1 and 
are therefore patcntably distinguishable over Kosuge, Bachelder, Buckley and the AAPA for at 
least the reasons set forth above. 
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With regard to Claim 11, Claim 1 1 is directed towards the processing apparatus for use in 
the system of claim 1, and is further limited by the feature of claim 5, Accordingly, Claim 1 1 is 
respectfully submitted as being patentable over Kosuge, Bachelder* Buckley and the AAPA for 
the reasons given in relation to claims 1 and 5. 

Claim 14 depends from amended Claim 1 and axe therefore patentably distinguishable 
over Kosuge, Bachcldcr, Buckley and the AAPA for at least the reasons set forth above in 
reference to Claim 1. 

With regard to claim 16, the features of this claim are dependent on Claim 5. Claim 16 is 
therefore patentably distinguishable over Kosuge, Bachelder, Buckley and the AAPA for at least 
the reasons set forth above in relation to claim 5. 

With regard to the features of claim 16, as set out above Bachelder only refers to a top or 
bottom edge of an object in a two dimensional image and not the upper or lower edges of an 
object represented by three dimensional data as required by claim 56 (when its dependency is 
taken into account). Nishiwaki (US 2002/0172422) discloses, at paragraph [0051], that the 
inside edges of character frames are detected. Neither Nishiwaki nor Bachelder disclose that 
object edge data points are arranged in sets in which each object edge data point in a respective 
set represents a common interior or exterior perimeter, and wherein the processing apparatus 
determines whether at least one object edge data component in each set relates to a lower edge of 
the object or to an upper edge of the object. 

Therefore, since Nishiwaki and Bachelder do not disclose cither individually or in 
combination the features of claim 16, they could not lead a skilled person to the subject matter of 
this claim. Further, both Nishiwaki and Bachelder relate to examining features of two 
dimensional images and so are not relevant to the invention of claim 1, which is concerned with 
generating three dimensional data representing the object from image data from a single image. 

With regard to claim 17, the features of this claim arc dependent on Claim 1 1 . Claim 17 
is therefore patentably distinguishable over Kosuge, Bachelder, Buckley ajid the AAPA for at 
least the reasons set forth above in relation to claim 1 1 . With regard to the features of claim 17, 
these are the same as for claim 16 and so the same comments apply. 
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Applicant respectfully requests reconsideration of the present application and respectfully 
solicits a Notice of Allowance of all claims. 

Should the Examiner have any questions or suggestions, she is invited to contact the 
undersigned at (616) 975-5506 or at collins@vglb.com. 

Respectfully submitted, 

By: Van Dyke, Gardner, Linn & Burkhart, LLP 
JAN ANTONTS 
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